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(57) ABSTRACT 

Digital audio and/or video programs that have been com- 
pressed on the basis of groups of pictures (GOPs) are 
recorded on a medium that allows immediate jumping 
between groups through co-storage of Transport Stream 
packets and pointer information. In particular, coexistently 
with the storing, successive pointers are derived in realtime 
from a primary Transport Stream that collectively point to 
data packets in a reconstructed Transport Stream which 
contains entry points. These pointers are stored at predeter- 
mined locations on the medium. 
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METHOD OF STORING DIGITAL AUDIO such recorded Transport Stream and to a device arranged for 

AND/OR VIDEO PROGRAMS COMPRESSED practising the invention. Further advantageous aspects of the 

ON THE BASIS OF GROUPS OF PICTURES invention are recited in dependent Claims. 

(GOPS) ON A MEDIUM WITH IMMEDIATE rrtff nFsrRiPTTnisr of thf nn awtnh 

JUMPING BETWEEN GROUPS THROUGH s BRIEF DESCRIPTI0N 0F ™ E DRAWING 

CO-STORAGE OF TRANSPORT STREAM These and further aspects and advantages of the invention 

PACKETS AND POINTER INFORMATION, A will be discussed more in detail hereinafter with reference to 

METHOD FOR READING SUCH the disclosure of preferred embodiments, and in particular 

INFORMATION, AND A DEVICE FOR with reference to the appended Figures that show: 

STORING AND/OR READING SUCH 10 FIG. -1, a block diagram of a recording organization; 

INFORMATION FIG. 2, a diagram of a Transport Stream structure; 

FIG. 3, a diagram of the stored data structure; 

BACKGROUND OF THE INVENTION FIG * 4 > a block dia 5 ram of a replaying organization; 

15 FIG. 5, packaging a Transport Stream; 

Hie invention relates to a method as recited in the FIG. 6, unpackaging a Transport Stream. 

preamble of claim 1. Classical video recording allows trick . 

modes such as fast forward and fast reverse. Trick modes STRUCTURAL DESCRIPTION OF A 
have become more complex to implement for digital video RELEVANT ENVIRONMENT 
that is compressed on the basis of groups of pictures (GOP), " According to their agreed upon format, Transport Stream 
because uniform video intervals may correspond to data Packets start with a Transport Stream packet header, which 
packet sequences of non-uniform lengths, depending on f the, contains a Packet IDentifier PID. Through the Program 
information content of the video. U.S. Pat. No. 5,701,386 Specific Information PSI tables, the data content in a IS 
allows fast forward and fast reverse by providing each packet will be known. The PID for the video data V_PID of 
Group of Pictures with a GOP header and each sequence of each transmitted program is stored in the PSI tables in the 
GOPs with sequence headers both before its first GOP and Transport Stream. A variable payload_unit_start_indicator 
also before its last GOP. Hereinafter, the term "picture" will pusi is stored in the Transport Stream packet header and 
be used consistently. Depending on ' the actual video indicates whether the payload of the packet in question starts 
standard, the term "picture" may-include "frame" as well as indeed with the first byte of a Packetized Elementary Stream 
"field". However, modern digital broadcast, in particular via 3o PES packet (ISO/IEC standards supra). Finally, the 
satellite, uses Transport Streams (TS) according to system adaptation_field_control (afc) indicates whether the Trans- 
layer standard ISO/IEC 13818-1 for transmitting, multi- por t Stream packet contains indeed an adaptation field 
channel audio and/or video. The video layer standard may be and/or a payload. 

H262 or ISO/IEC 13818-2, the audio layer standard ISO/ t 0 set a pointer, the system usually only needs to access 

IEC 13818-3. These features are used inter alia for DVB and packets that have PID™ V PID, pusi—1 and an afc that is 

are intended for linear play without feedback from a either equal to 1 or equal to~3. If the table would be too long - 

decoder. Packets arrive at a receiver one by one and their f or a smg fe 188 byte packet, two or more contiguous packets 

assignment to a particular program is generally not known, witn pid^V_PID must be accessed. Only packets so sig- 

before the packet itself will have arrived: indeed, assignment nalled need be checked for presence of an entry point. Entry 

is through PSI-tables. For storage, o ne or more specifi c ^ points may be ^ f 0 n 0W s: 

programs are selected ho^ ^S^^^^ &^S^ 1 ' a TS packet with the start of an I-picture; 

Thi^alLBfifi^^ a kct with the start of a G0P 

the adapting of certain strea lT T ua r um^tci&^ fef^etaTrniTj^a _^ , . , , „ , 

— 2 -~-r-(57 c r^- — a TS packet with the start ot a sequence header. 

valid Trans port Stream for replay. — — ^_ *\ . n n .„ 

— — *« — — — » i. £ — * The pointers may be transiently stored in RAM memory 

Replay systems will generally support jumping over a 45 and eventlially writtcn to disc . A program with a video take 

selectable physical storage distance, but the probability of lenglh of 135 minutes with 25 ictures a 

then hitting an entry point to the actually stored program is i 2 - p icture GOP size and a pointer length of 4 bytes, will 

low. The finding of such entry points will necessitate pro duce about 0.54 Mbit or 67 kByte pointer information. At 

repeated and time intensive searches, which may cause a 16 Mbaud transfer speed, writing all pointers this wiU need 

buffer underflow. It also becomes nearly impossible to 5Q about 35 millisecs, provided they get a separate disc area. If 

replay the stream at an n times higher speed with n integer, ram is too small , ^ must be written earlier ^ 

as well as to land immediately on a video fragment that may inlers 5e kept within the stored streani) sucn as by 

be played independently. Therefore, if storage takes place on storing them wnen reaching a certaia aumber such M 10fJ0 

a dedicated apparatus, the locations of the entry points must selected packets At replav> pointer positions will then be 

be immediately known, either directly, or via pointers. The 55 kn0WQ irmnediately . Alternatively, a table of pointer loca- 

problem becomes more severe if a plurality of program must lions may be ^ If the pointers are kept QQ a 

be stored. location, they may be written either after a certain time 

SUMMARY TO THE INVENTION interval, or at instants when actual bitrate is low, or anyway 

before reaching buffer storage capacity. 

In consequence, amongst other things, it is an object of the 60 The following further information may be stored with the 

present invention to format stored video in such manner that pointers to facilitate the replay of a stored program: 

various trick modes will become feasible for a Transport the length in seconds of the video at recording time to . 

Stream environment, whilst maintaining the data handling calculating the, remaining time; 

facilities proper to this environment. s i ze Q f the GOPs, and if applicable, the characterization of 

Now therefore, according to one of its aspects the inven- 65 the GOPs as being closed or non-closed, such as accord- 

tion is characterized according to the characterizing part of ing to MPEG-standard, and whether their sizes are uni- 

claim 1. The invention also relates to a method for replaying form or not; 
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the PID of packets containing the Program Map Table PMT; 
the PID of packets storing the Program Clock Reference 
PCR; 

the PID of packets with video information; 

Start Time Code that may be used to calculate elapsed time; S 

Frame Rate that in combination with a uniform GOP size 

may be used to jump to a particular instant in time; 
the total number of TS packages which may be used to 

calculate the end of the program in question; 
the overall numbers of I- r B- and P-pictures; 10 
the total number of I-pictures; 

average bitrate. , 
The use of Pointers may support replaying of a particular 
program at higher speed. Transport Stream conditions 
should be maintained by avoiding referencing non-existent 15 
pictures. Further, certain fields may have to be adapted. 

Trick play is facilitated by forwarding to a decoder only 
TS packets that contain video information, inclusive of SI 
information and PCR packets. Faster play of sound is 
generally not useful. The storing of extra information will 20 
allow to select for forwarding exclusively those packets that 
have a PID corresponding to that of PAT, PMT, PCR, and 
V_PID. The GOP size information may be used for in a 
"non-closed" GOP environment, during replay of complete 
GOP's, selectably bypassing a particular B-picture, and 
possibly to adapt temporal references in other packages. The 
video duration at recording time may be used, in combina- 
tion with the time code stored in the GOP header to calculate 
and display elapsed time. The combination of frame rate and 
a fixed GOP size allows to periodically replay exactly a 30 
specified number of seconds, and to subsequently jump n 
times the earlier number, where n may have values such as 
in the range 1-100. An extra advantage of pointer-supported 
storage is that a program need to be stored only once. The 
described organization supports the recording of a plurality 35 
of programs in parallel in the secondary Transport Stream in 
an interleaved manner. In that case, each program will need 
its associated array of pointers. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

FIG. 1 is a block diagram of an exemplary recording ' 
organization. Input 20 receives a Transport Stream. In block 
22, selection of the required TS packets and time stamp . 
insertion take place, followed by storing in Stream Info 45 
Memory 24. In block 26, the selected TS packets are < 
counted, and the count actually attained is forwarded to 
Pointer Info Memory 28. In block 32, entry points are 
extracted, and counted in block 30: the count is forwarded 
both to Pointer Info Memory 28 and to Stream Info Memory 50 
36 that is in fact the same as block 24. In block 34, the Time 
Code is retrieved from the GOP header and if its value is 
zero, any necessary modification may be effected. In block, 
38, the Start Time Code is extracted for forwarding to the 
Stream Info Memory. In block 40, the GOP size and Picture 55 
Rate informations are extracted and forwarded to Stream 
Info Memory, now block 50. In block 42, the Closed GOP 
Indicator is extracted, in block 44 the PCR_PID, in block 46 
the PMTJID, and in block 48 the video PID, all for 
forwarding to the Stream Info Memory 50. The information 60 
on output 49 is ready for being stored. The Figure does not 
specify the mapping of various partial functionalities on 
proper hardware, which may be realized as conventional 
mechanisms that have not been shown for brevity. 

FIG. 2 is a diagrammatical embodiment of the Transport 65 
Stream structure. Here, the uppermost level shows the 
sequence of Transport Stream Packets that each contain 188 



bytes. On the next level a packet consists of a 4-Byte header 
that accommodates at least the informations PID, pusi and 
afc. The remainder is the TS -packet data. On the third level 
the data field may contain an adaptation field and/or a 
pay load field that are sized according to need, and may be 
internally specified through the afc information. 

FIG. 3 is a diagram of the stored data structure. Block 64 
symbolizes the stream information formed by TS packets 
containing all information that has been selected on the basis 
of the information stream received on input 22 in FIG. 1. 
Block 62 symbolizes the pointer information that has been 
produced by blocks 26, 30, 32 in FIG. 1. Block 60 symbol- 
izes the stream information produced by the various blocks 
in FIG. 1, such as in particular blocks 22, 30, 38, 40, 42, 44, 
46 and 48. Now, first the informations from blocks 60 and 
62 are combined for contiguous storage. Next, the com- 
pound so formed, as well as the informations from block 64 
are stored on the medium. The latter informations may be 
stored in physically distant locations from the former: the 
linking is through the file system. The overall information is 
collectively stored on disc in a format that may J 

ie exempla ry teachings of FIG^JL-flJunng a 
program, TS pacxets wdl D Cwti t lou luTff mually. Pointer and 
stream informations are being written either after termina- 
tion of the video take, or in rela tively sm a 1 1 -sized a m, qh nf ,fj 
■durin ethe video take. 

FIG. 4 is a block diagram of an exemplary replaying 
organization. Item 70 represents the rewritable storage disc 1 
together with its associated electromechanical, electro - 
optical and electronic components for driving and informa- 
tion accessing, inclusive of demodulation, error correction 
and similar features that operate on a relatively lower 
organizational level than the present invention. Block 72 
executes demultiplexing into three sub-streams. Block 74 
symbolizes the Pointer Info Memory substream. Block 76 
symbolizes the Stream Info Memory substream. These two 
streams are forwarded to control unit 80 that may execute 
the following user control functions: 
setting the disc replay velocity, such as 1 ... n times normal 
speed; 

optionally, setting the minimum play duration before effect- 
ing a jump; here, various possibilities exist, such as play 
n GOPS before a jump, jump speed xn GOPs, or: play an 
I-picture, repeat n times, then jump to the next I -picture, 
etcetera; 

if a plurality of programs had been stored: program select; 
setting the video start position where to start playing the 

program in question from; 
play/record; 
stop; 

goto a specified point in time; 
fast forward & fast reverse. 

Control functions are for example as follows: 
display actually elapsed time from the start of the program 

that is being read out; 
retrieving pointer and stream information from disc; 
control goto operations to specific byte positions such as to 

access an entry point; 
play as starting from a specified physical location; 
record unto a specified physical location. 

The control unit may forward signals so developed along 
control lines 92, 94, 96, 98 to various subsystems to be 
identified hereinafter. First, the disc-oriented subsystem 70 
is controlled along line 92. The Transport Stream demulti- 
plexed from block 72 is forwarded to block 82 for extracting 
of the time code. Block 84 detects whether the indicator 
Closed-GOP is false (*1) and play n GOPs, replace first 
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B -picture packets with null packets. Furthermore, block 84 immediate jumping between groups through co-storage of 
detects whether the indicator Closed-GOP is false (*1), or Transport Stream packets and pointer information, 
play I-pictures only, update continuity counter in the TS characterized by coexistently with said storing, in real- 
packet header, update temporal reference in picture header, time deriving from a primary Transport Stream succes- 
and set broken link in GOP header to 1, the latter depending 5 sive pointers that collectively point to data packets in a 
on the decoder type. secondary Transport Stream that contains entry points, 
Block 86 detects whether replay speed *1, and in the a ^d which pointers are stored at predetermined loca- 
positive case replaces all TS packets, except Video PID tions on said medium. 

packets, PCR PID packets, PMT PID packets and PAT 2 - A method as claimed in claim 1, wherein said prede- 

PID(O) packets with null packets. Furthermore, Presentation 10 termmed locations are within said secondary Transport 

Time Stamp, Decoding Time Stamp, and PCR numbers are str eam. 

modified to reflect the correct presentation and decoding # 3 * A as Maimed in claim 1, wherein said prede- 

t - „ termined locations are in a Table area outside said secondary 

umes. Trans t St 

Block 88 detects whether there are timestamps or not; in Tl°LthodZ claimed in claim 1, for use with a plurality 

the positive case, the Time Base is reconstructed and the is of interleaved programs in said se c 0ndary stream, whilst 

Time Stamps removed. Output 90 will present an amended providing each such program with a { * of pointers. 

Transport Stream according to the MPEG-2 standard. For 5 . Amethod as claimed in claim 1, furthermore indicating 

brevity, the Figure does not specify mapping various partial a s ize 0 f the GOPs, and if applicable, a characterization of 

functionalities on hardware. the GOPs as being closed or non-closed, and whether their 

A particular aspect of a Transport Stream is that all TS ao sizes are uniform or not. 

packets will start with a TS Header that contains a PID. 6. Amethod as claimed in claim 1, furthermore indicating 

FIG. 5 illustrates the packaging of a Transport Stream. At a PID of a packet containing a Program Map Table, 

left, both video data and audio data arrive at their respective 7. Amethod as claimed in claim 1, furthermore indicating 

encoders 110 and 112. Both encoders then feed respective a PID of a packet containing a Program Clock Reference, 

packetizers 112 and 116, respectively to produce a stream of 25 8. Amethod as claimed in claim 1, furthermore indicating 

video PES and a stream of audio PES. In multiplexer 118, a PID of a packet that contains video information, 

the two streams are multiplexed to constitute an input 9. A method as claimed in claim 1, furthermore indicating 

Transport Stream that is ready for storage. a Start Time Code to be used to calculate elapsed time. 

FIG. 6 illustrates unpackaging a Transport Stream. At left, 10. Amethod as claimed in claim 1, furthermore indicat- 

a compound Transport Stream enters a demultiplexer annex 30 ing a Frame Rate to be used in combination with a uniform 

decoder 120, that will separate video from audio. Block 126 GOP size to jump to a particular instant in time, 

is furthermore operative for clock extraction, and synchro- U. A method for replaying one or more digital audio 

nizes video decoder blocks 122 and audio decoder block and/or video programs with coded data that have been 

124. The decoded video and audio informations are then compressed on the basis of groups of pictures (GOPs), from 

available for consumer replay. 35 a medium that allows immediate jumping between groups 

Various relevant aspects of the invention are as follows: through stored Transport Stream packets and pointer 

The elapsed time indicator may be retrieved from the information, 

GOP-header and the Start Time Code and is independent characterized by accessing in an individual or compound 

from bitrate and GOP-size; Transport Stream being replayed, in realtime succes- 

Fast forward and fast reverse are feasible at any speed, even 40 sive pointers that collectively point to data packets in a 

if a single disc contains more programs in a physically, particular individual Transport Stream that contains 

but not logically intermixed manner; entry points, by accessing such pointers at prede ter- 

Both the pointer table and the TS information may be stored mined locations on said medium. 

on an arbitrary disc location. There is some kind of Table 12. A method as claimed in claim 11, wherein said 

Of Contents that for all programs contains starting loca- 45 predetermined locations are within said secondary stream. 

tions of the TS packets/program, of the pointer tables and 13, A method as claimed in claim 11, wherein said 

of the TS information tables. predetermined locations are in a Table area outside said 

Trick play requires no extra regrouping or reformatting of secondary stream. 

the picture sequences; 14. A method as claimed in claim 11, furthermore retriev- 

Extemal as well as an internal decoders may be used; 50 ing a Frame Rate indication for use in combination with a 

No explicit sector argument needed for TS-packets contain- uniform GOP size to jump to a particular instant in time. 

ing an entry point; 15. A recording device arranged for practising a method 

Data need not be stored in a physically contiguous manner; as claimed in claim 1. 

Interleaved storage of audio, video and other data is allowed; 16. A replay device arranged for interfacing to informa- 

The invention allows all GOP-sizes, even non-uniform 55 tion that has been recorded according to a method as claimed 

GOP-sizes. in claim 1. 

What is claimed is: 17. A device as claimed in claim 15, and arranged for 

1. A method for recording one or more digital audio interfacing to a rewritable disc, 
and/or video programs that have been compressed on the 

basis of groups of pictures (GOPs), on a medium that allows ***** 
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